Spontaneously emerging internal models of visual sequences combine abstract and event-specific information in the prefrontal cortex.

When exposed to sensory sequences, do macaque monkeys spontaneously form abstract internal models that generalize to novel experiences? Here, we show that neuronal populations in macaque ventrolateral prefrontal cortex jointly encode visual sequences by separate codes for the specific pictures presented and for their abstract sequential structure. We recorded prefrontal neurons while macaque monkeys passively viewed visual sequences and sequence mismatches in the local-global paradigm. Even without any overt task or response requirements, prefrontal populations spontaneously form representations of sequence structure, serial order, and image identity within distinct but superimposed neuronal subspaces. Representations of sequence structure rapidly update following single exposure to a mismatch sequence, while distinct populations represent mismatches for sequences of different complexity. Finally, those representations generalize across sequences following the same repetition structure but comprising different images. These results suggest that prefrontal populations spontaneously encode rich internal models of visual sequences reflecting both content-specific and abstract information.

Creating a window into the mind.

A noninvasive imaging technique measures neuronal activity at a millisecond time scale.

Decoding rapidly presented visual stimuli from prefrontal ensembles without report nor post-perceptual processing.

The role of the primate prefrontal cortex (PFC) in conscious perception is debated. The global neuronal workspace theory of consciousness predicts that PFC neurons should contain a detailed code of the current conscious contents. Previous research showed that PFC is indeed activated in paradigms of conscious visual perception, including no-report paradigms where no voluntary behavioral report of the percept is given, thus avoiding a conflation of signals related to visual consciousness with signals related to the report. Still, it has been argued that prefrontal modulation could reflect post-perceptual processes that may be present even in the absence of report, such as thinking about the perceived stimulus, therefore reflecting a consequence rather than a direct correlate of conscious experience. Here, we investigate these issues by recording neuronal ensemble activity from the macaque ventrolateral PFC during briefly presented visual stimuli, either in isolated trials in which stimuli were clearly perceived or in sequences of rapid serial visual presentation (RSVP) in which perception and post-perceptual processing were challenged. We report that the identity of each stimulus could be decoded from PFC population activity even in the RSVP condition. The first visual signals could be detected at 60 ms after stimulus onset and information was maximal at 150 ms. However, in the RSVP condition, 200 ms after the onset of a stimulus, the decoding accuracy quickly dropped to chance level and the next stimulus started to be decodable. Interestingly, decoding in the ventrolateral PFC was stronger compared to posterior parietal cortex for both isolated and RSVP stimuli. These results indicate that neuronal populations in the macaque PFC reliably encode visual stimuli even under conditions that have been shown to challenge conscious perception and/or substantially reduce the probability of post-perceptual processing in humans. We discuss whether the observed activation reflects conscious access, phenomenal consciousness, or merely a preconscious bottom-up wave.

Sensitivity to geometric shape regularity in humans and baboons: A putative signature of human singularity.

Among primates, humans are special in their ability to create and manipulate highly elaborate structures of language, mathematics, and music. Here we show that this sensitivity to abstract structure is already present in a much simpler domain: the visual perception of regular geometric shapes such as squares, rectangles, and parallelograms. We asked human subjects to detect an intruder shape among six quadrilaterals. Although the intruder was always defined by an identical amount of displacement of a single vertex, the results revealed a geometric regularity effect: detection was considerably easier when either the base shape or the intruder was a regular figure comprising right angles, parallelism, or symmetry rather than a more irregular shape. This effect was replicated in several tasks and in all human populations tested, including uneducated Himba adults and French kindergartners. Baboons, however, showed no such geometric regularity effect, even after extensive training. Baboon behavior was captured by convolutional neural networks (CNNs), but neither CNNs nor a variational autoencoder captured the human geometric regularity effect. However, a symbolic model, based on exact properties of Euclidean geometry, closely fitted human behavior. Our results indicate that the human propensity for symbolic abstraction permeates even elementary shape perception. They suggest a putative signature of human singularity and provide a challenge for nonsymbolic models of human shape perception.

A theory of memory for binary sequences: Evidence for a mental compression algorithm in humans.

Working memory capacity can be improved by recoding the memorized information in a condensed form. Here, we tested the theory that human adults encode binary sequences of stimuli in memory using an abstract internal language and a recursive compression algorithm. The theory predicts that the psychological complexity of a given sequence should be proportional to the length of its shortest description in the proposed language, which can capture any nested pattern of repetitions and alternations using a limited number of instructions. Five experiments examine the capacity of the theory to predict human adults' memory for a variety of auditory and visual sequences. We probed memory using a sequence violation paradigm in which participants attempted to detect occasional violations in an otherwise fixed sequence. Both subjective complexity ratings and objective violation detection performance were well predicted by our theoretical measure of complexity, which simply reflects a weighted sum of the number of elementary instructions and digits in the shortest formula that captures the sequence in our language. While a simpler transition probability model, when tested as a single predictor in the statistical analyses, accounted for significant variance in the data, the goodness-of-fit with the data significantly improved when the language-based complexity measure was included in the statistical model, while the variance explained by the transition probability model largely decreased. Model comparison also showed that shortest description length in a recursive language provides a better fit than six alternative previously proposed models of sequence encoding. The data support the hypothesis that, beyond the extraction of statistical knowledge, human sequence coding relies on an internal compression using language-like nested structures.

The Contribution of AMPA and NMDA Receptors to Persistent Firing in the Dorsolateral Prefrontal Cortex in Working Memory.

Many tasks demand that information is kept online for a few seconds before it is used to guide behavior. The information is kept in working memory as the persistent firing of neurons encoding the memorized information. The neural mechanisms responsible for persistent activity are not yet well understood. Theories attribute an important role to ionotropic glutamate receptors, and it has been suggested that NMDARs are particularly important for persistent firing because they exhibit long time constants. Ionotropic AMPARs have shorter time constants and have been suggested to play a smaller role in working memory. Here we compared the contribution of AMPARs and NMDARs to persistent firing in the dlPFC of male macaque monkeys performing a delayed saccade to a memorized spatial location. We used iontophoresis to eject small amounts of glutamate receptor antagonists, aiming to perturb, but not abolish, neuronal activity. We found that both AMPARs and NMDARs contributed to persistent activity. Blockers of the NMDARs decreased persistent firing associated with the memory of the neuron's preferred spatial location but had comparatively little effect on the representation of the antipreferred location. They therefore decreased the information conveyed by persistent firing about the memorized location. In contrast, AMPAR blockers decreased activity elicited by the memory of both the preferred and antipreferred location, with a smaller effect on the information conveyed by persistent activity. Our results provide new insights into the contribution of AMPARs and NMDARs to persistent activity during working memory tasks.SIGNIFICANCE STATEMENT Working memory enables us to hold on to information that is no longer available to the senses. It relies on the persistent activity of neurons that code for the memorized information, but the detailed mechanisms are not yet well understood. Here we investigated the role of NMDARs and AMPARs in working memory using iontophoresis of antagonists in the PFC of monkeys remembering the location of a visual stimulus for an eye movement response. AMPARs and NMDARs both contributed to persistent activity. NMDAR blockers mostly decreased persistent firing associated with the memory of the neuron's preferred spatial location, whereas AMPAR blockers caused a more general suppression. These results provide new insight into the contribution of AMPARs and NMDARs to working memory.

Benchmarking laminar fMRI: Neuronal spiking and synaptic activity during top-down and bottom-up processing in the different layers of cortex.

High resolution laminar fMRI is beginning to probe responses in the different layers of cortex. What can we expect this exciting new technique to discover about cortical processing and how can we verify that it is producing an accurate picture of the underlying laminar differences in neural processing? This review will address our knowledge of laminar cortical circuitry gained from electrophysiological studies in macaque monkeys with a focus on the primary visual cortex, as this area has been most often targeted in both laminar electrophysiological and fMRI studies. We will review how recent studies are attempting to verify the accuracy of laminar fMRI by recreating the known laminar profiles of various neural tuning properties. Furthermore, we will examine how feedforward and feedback-related neural processes engage different cortical layers, producing canonical patterns of spiking and synaptic activity as estimated by the analysis of current-source density. These results provide a benchmark for recent studies aiming to examine the profiles of bottom-up and top-down processes with laminar fMRI. Finally, we will highlight particularly useful paradigms and approaches which may help us to understand processing in the different layers of the human cerebral cortex.

Axonal plasticity associated with perceptual learning in adult macaque primary visual cortex.

Perceptual learning is associated with changes in the functional properties of neurons even in primary sensory areas. In macaque monkeys trained to perform a contour detection task, we have observed changes in contour-related facilitation of neuronal responses in primary visual cortex that track their improvement in performance on a contour detection task. We have previously explored the anatomical substrate of experience-dependent changes in the visual cortex based on a retinal lesion model, where we find sprouting and pruning of the axon collaterals in the cortical lesion projection zone. Here, we attempted to determine whether similar changes occur under normal visual experience, such as that associated with perceptual learning. We labeled the long-range horizontal connections in visual cortex by virally mediated transfer of genes expressing fluorescent probes, which enabled us to do longitudinal two-photon imaging of axonal arbors over the period during which animals improve in contour detection performance. We found that there are substantial changes in the axonal arbors of neurons in cortical regions representing the trained part of the visual field, with sprouting of new axon collaterals and pruning of preexisting axon collaterals. Our findings indicate that changes in the structure of axonal arbors are part of the circuit-level mechanism of perceptual learning, and further support the idea that the learned information is encoded at least in part in primary visual cortex.

Layer-specificity in the effects of attention and working memory on activity in primary visual cortex.

Neuronal activity in early visual cortex depends on attention shifts but the contribution to working memory has remained unclear. Here, we examine neuronal activity in the different layers of the primary visual cortex (V1) in an attention-demanding and a working memory task. A current-source density analysis reveales top-down inputs in the superficial layers and layer 5, and an increase in neuronal firing rates most pronounced in the superficial and deep layers and weaker in input layer 4. This increased activity is strongest in the attention task but it is also highly reliable during working memory delays. A visual mask erases the V1 memory activity, but it reappeares at a later point in time. These results provide new insights in the laminar circuits involved in the top-down modulation of activity in early visual cortex in the presence and absence of visual stimuli.

Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex.

Cognitive functions rely on the coordinated activity of neurons in many brain regions, but the interactions between cortical areas are not yet well understood. Here we investigated whether low-frequency (α) and high-frequency (γ) oscillations characterize different directions of information flow in monkey visual cortex. We recorded from all layers of the primary visual cortex (V1) and found that γ-waves are initiated in input layer 4 and propagate to the deep and superficial layers of cortex, whereas α-waves propagate in the opposite direction. Simultaneous recordings from V1 and downstream area V4 confirmed that γ- and α-waves propagate in the feedforward and feedback direction, respectively. Microstimulation in V1 elicited γ-oscillations in V4, whereas microstimulation in V4 elicited α-oscillations in V1, thus providing causal evidence for the opposite propagation of these rhythms. Furthermore, blocking NMDA receptors, thought to be involved in feedback processing, suppressed α while boosting γ. These results provide new insights into the relation between brain rhythms and cognition.

Distinct roles of the cortical layers of area V1 in figure-ground segregation.

BACKGROUND: What roles do the different cortical layers play in visual processing? We recorded simultaneously from all layers of the primary visual cortex while monkeys performed a figure-ground segregation task. This task can be divided into different subprocesses that are thought to engage feedforward, horizontal, and feedback processes at different time points. These different connection types have different patterns of laminar terminations in V1 and can therefore be distinguished with laminar recordings. RESULTS: We found that the visual response started 40 ms after stimulus presentation in layers 4 and 6, which are targets of feedforward connections from the lateral geniculate nucleus and distribute activity to the other layers. Boundary detection started shortly after the visual response. In this phase, boundaries of the figure induced synaptic currents and stronger neuronal responses in upper layer 4 and the superficial layers ~70 ms after stimulus onset, consistent with the hypothesis that they are detected by horizontal connections. In the next phase, ~30 ms later, synaptic inputs arrived in layers 1, 2, and 5 that receive feedback from higher visual areas, which caused the filling in of the representation of the entire figure with enhanced neuronal activity. CONCLUSIONS: The present results reveal unique contributions of the different cortical layers to the formation of a visual percept. This new blueprint of laminar processing may generalize to other tasks and to other areas of the cerebral cortex, where the layers are likely to have roles similar to those in area V1.